Solving the exploration/exploitation trade-off is a fundamental issue for an organism living in an uncertain and changing environment. This review describes how a stream of cognitive neuroscience studies linked exploratory behaviour to structures in the human prefrontal cortex, then identified the brain mechanisms involved in the online adaptation of behaviour relatively to reward changes, and finally revealed fundamental limitations in the processing of information at the prefrontal level. The experiments and the results we present could particularly be of interest to economists who want to understand how cognitive neuroscience identify key processes in the human brain and shapes our understanding of decision-making.